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(54) MULTI-PROJECTION IMAGE DISPLAY DEVICE 

(57) A multi-projection image display device using a 
plurality of image projectors to form one picture on a 
screen, in which images projected from the projectors 
are smoothly connected with one another, so that 
seams of the images do not appear conspicuously. The 
image display device has projectors (0121. 0122, 0123, 
0124) and a screen (0140) laid out In such a manner 
that maximum image projection ranges (0151, 0152, 
0153. 0154) of the respective projectors ovelap the 
adjacent ranges. An image signal control unit (0110) for 
processing an image signal supplied from an external 
image input (0180) has, therein, a member for cutting 
out a partial image area dealt with by each projector, an 
image converting member for performing geometric 
transformation and local color correction of the partial 
image, and an ar'rthmetic control member for controlling 
the image converting member on the basis of image 
information inputted from a screen state monitor cam- 
era (0130). With this structure, smoothing of the seams 
between the images may be realized simply by image 
signal processing, and precise adjustment of the optical 
system of the projectors becomes unnecessary. 
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Description 
Technical Field 

5 [0001] This invention relates to an image display device which combines two or more images for display. Particu- 
larly it relates to a multi-projection image display device which combines images projected from a plurality of projection 
type display units to form one picture on a screen, and concerns a device or method for realizing smoothing of the 
seams between images. 

10 Background Art 

[0002] In combining several images, for example, using a multi-projector device composed of a plurality of projec- 
tors, it is ideal that the seams between Images projected from neighboring projectors can be so smoothly joined as to 
look invisible, forming one picture (or pictures) on a screen. 

15 [0003] Conventionally the method as disclosed In the Japanese Patent Prepublication No. 94974/96 has been 
employed to realize this. For example, to prevent the projection range of each projector on the screen from overlapping 
that of an adjacent projector, a shielding plate is installed in the border between neighboring image projection ranges 
perpendicularly to the screen in such a way that light from one projector does not enter the projection range of the adja- 
cent projector. In addition, transmission type screens with different polarization characteristics are provided between 

20 neighboring projection ranges so that light from adjacent projectors cannot reach the viewer physically. 

[0004] In the above optical method for combining neighboring images, however, it is necessary to physically define 
the image projection range of each projector beforehand. This necessitates adjustment of projectors so that the pro- 
jected image precisely coincides with the defined projection range. This adjustment includes adjusting the projector 
angle and the Internal optical system of each projector, or in case of cathode-ray tube type projectors, adjusting deflect- 

25 Ing voltage waveforms to reshape the projected Images. 

[0005] However, in case of liquid crystal projectors, reshaping of projected Images is not so easy as in case of cath- 
ode-ray tube type projectors and only optical adjustments are used to change the image projection position and shape, 
though the freedom of adjustment is limited. 

[0006] These adjustment methods are not only troublesome; they need frequent readjustments because optimum 
30 adjustment levels easily vary with variation in the temperature and magnetic field of the room in which the adjusted pro- 
jectors are installed. Therefore, as far as the conventional methods are used, it is very difficult to display on a screen a 
whole picture (or pictures) composed of several images with smooth seams. 

[0007] Also, installation of shielding plates on the screen might unfavorably affect the uniformity of the screen itself, 
which might be reflected in projected images, so a smoothly joined picture could not be obtained. 

35 

Disclosure of the Invention 

[0008] This invention is intended to solve the problem. It makes unnecessary a special screen structure for preven- 
tion of penetration of light from adjacent projectors as well as precise optical adjustment of projectors, while realizing 
40 smoothly joined Images in which their seams are not conspicuous. According to the invention, even image projection by 
projectors can also be made by image signal processing. 

[0009] To achieve the atx}ve-said object, the invention has the following structure. 

[001 0] According to the invention, adjustment is made on overlapping parts (signals) of several images on a projec- 
tion surface (for example, a screen). Specifically, in terms of image signals supplied to projectors which project Images 

45 from the back or front of the screen, a partial image area to be dealt with by each projector is cut out to generate corre- 
sponding image signal, which is processed to perform reshaping or geometric transformation of the projected image 
and local color correction. This process may be implemented using either hardware or software. 
[0011] In addition, the invention is characterized in that, as an Image display method employed in a multi -projection 
image display device provided with a plurality of image output units, on a display screen which displays images pro- 

50 jected from said Image output units, the image projection area of one of said image output units overlaps that of another 
image output unit, and said image output unit and said other image output unit deliver mutually correlated images to the 
image overlap area. 

(001 2] Here, the control parameter to be used for the geometric transformation and color correction may be gener- 
ated. The control parameter can be generated as follows: the image signal for a desired image pattern is supplied to 
55 each projector, the state of the projected image on the screen is read and the control parameter is calculated from the 
image state data thus read. 

[0013] For each projector, which is In charge of an image projection range adjacent to another Image projection 
range, it is desirable to set its position, angle and optical system so that its maximum Image projection range on the 
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screen overlaps that of the adjacent maximum image projection range by a few percent in the border. The areas where 
neighboring maximum image projection ranges overlap each other are areas where the images projected from the 
respective neighboring projectors in charge of these projection ranges an optically added or integrated. The state of the 
image projection on the screen as a result of this optical image addition is read and the read image data is used to cal- 

5 culate control parameters to make an optical Image addition model, and use said model to obtain necessary control 
parameters for geometric transformation and local color correction of the supplied images (signals) so that smooth con- 
nection of neighboring images can be made as a result of optical image addition. According to the obtained geometric 
transformation and local color correction parameters, image geometric transforrration and local color correction are 
carried out and the processed image signals are supplied to the projectors. 

10 [0014] The invention constitutes a multi-projection image display device to form one or more pictures on a screen, 
characterized by having image projectors which project images on said screen and a control unit which, wrhen the 
image projection display range on said screen of one of the projectors has an area which overlaps that of another pro- 
jector. enat)les said projector and said other projector to output mutually correlated images to said overlap area on said 
screen. 

15 [001 5] The invention also includes a computer readable storage medium which stores a program to ensure that, on 
a screen where image output units display images, the image display range of one of said image output units and that 
of another image output unit partially overlap, and that said image output unit and said other image output unit output 
mutually correlated images. The invention also constitutes an Image signal regenerator which comprises storage media 
to store image data in divided form for the respective image output units so that said image output unit and said other 

20 image output unit can output mutually correlated images to the area where images from the image output units overlap: 
and image signal supply units which supply image signals based on image data read from said storage media. 
[0016] The invention eliminates the need for readjustments of components such as the screen and projectors, 
because It only needs adjustments relating to image overlap areas. Specifically, it involves making an optical Image 
addition model depending on the conditions of the screen, projectors and other components and using the model to 

25 obtain a solution; as a result, components such as the screen and projectors need not be readjusted as far as an optical 
image addition model which has a solution can be obtained. 

Brief Description of Drawings 

30 [0017] 

Fig. 1 shows the arrangement of projectors, a screen, and a screen state monitor camera In an embodiment of this 
Invention. Fig. 2 shows a functional block diagram of an image signal control unit. Fig.3 shows positional relation- 
ship on the screen between the maximum image projection ranges of projectors and the projection ranges of 

35 images processed by the image signal control unit. Fig.4 shows the positional relationship between the maximum 
Image projection range of a single projector and the projection range of an image processed by the image signal 
control unit. Fig.5 is a functional block diagram of an image corrector. Fig.6 shows the Internal functional structures 
of the functional blocks of the Image corrector shown In Fig.5. Fig.7 shows the operational sequence for a video 
signal digitizer. Fig.8 shows a frame buffer writing or reading sequence. Fig.9 shows the sequence for geometric 

40 transformation of images. Fig.lO shows a geometric transformation vector table data structure. Fig. 11 shows a 
color transfomriation sequence. Fig. 12 shows a color transformation parameter table data structure. Fig. 13 shows 
an example of an image pattern for correction. Fig.14 shows the image projection ranges before and after geomet- 
ric transformation. Fig. 1 5 shows four types of overiap of two neighboring maximum Image projection ranges. Fig. 1 6 
shows the sequence for geometric transformation control data generation. Fig.1 7 shows the sequence for geomet- 

45 ric transformation vector generation. Fig.1 8 shows the sequence for pixel data conversion parameter generation. 
Fig. 19 shows an example of a picture composed of four mutually overlapping quarter Images. Fig. 20 shows the 
relationship of overlap areas of neighboring partial images. Fig.21 is a graph showing a weight function used for 
brightness modulation of image overlap areas. Fig.22 is a block diagram showing projectors with image correctors 
built in and an image signal control unit. Fig.23 shows an example of a multi-projection image display device that 

so employs a curved surface screen. Fig.24 is a block diagram showing a set of image reproduction units that repro- 
duce partial Image signals In parallel and an image signal control unit that has no Image correctors. Fig. 25 shows 
an Image reproduction device that Incorporates an Image corrector and a temporary Image storage unit 

Best Mode for Candying Out the Invention 

55 

[0018] Fig.1 shows a system configuration with an array of projectors according to tills invention. Four projectors 
0121, 0122. 0123, 0124 are arranged in a way that their maximum image projection ranges 0151, 0152, 0153, 0154 
overiap a bit one another on a rear projection screen 0140. Image signals are supplied from an image signal control unit 
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0110 to the four projectors 0121 . 0122. 0123. 0124. The image signal control unit 01 10 has a function to process image 
signals supplied from an external image input 0180 and supply such processed signals to the four projectors 0121, 
0122. 0123, 0124 and an image correction function to determine how the images are processed. The way the image 
signal control unit 0110 corrects images is determined according to image signals from a screen state monitor camera 

5 0130 that reads the state of images projected on the screen 0140. 

[0019] Fig.2 is a block diagram showing the functional structure of the image signal control unit 01 10. The image 
signal control unit has the following input and output terminals: a whole image input 0210. partial image inputs 0221. 
0222. 0223, 0224. a screen state monitor camera image input 0230. and partial Image outputs 0241 . 0242. 0243, 0244. 
[0020] The image signal supplied from the whole image input 0210 is split by an image splitter 0250 into partial 

10 image signals that correspond to the projectors connected to the partial image outputs 0241 . 0242, 0243, 0244 respec- 
tively; these partial image signals are each sent to an image signal selector 0260. 

[0021] The image signal selector 0260 selects one of the following image signal sets: the image signal set as input 
from the image splitter 0250. the Image signal set as input from a test pattern generator 0270, and the set of partial 
Image Inputs 0221 . 0222, 0223. 0224. Then it supplies the selected set of Image signals to the corresponding image 

15 correctors 0281, 0282. 0283, 0284, respectively. 

[0022] An image correction parameter generator 0290 controls the test pattern generator 0270 to select geometric 
pattern image signals by means of the image signal selector 0260 and send them through the image correctors 0281. 
0282. 0283. 0284 to the projectors 0121 , 0122, 0123, 0124 connected to the partial Image outputs 0241, 0242. 0243, 
0244; it also loads image signals from the screen state monitor camera 0130 which monitors, through a screen state 

20 monitor camera image input 0230, the projection of that geometric pattern on the screen. Based on the image obtained 
through the screen state monitor camera image input 0230, the image correction parameter generator 0290 works out 
image correction parameters that enable the Images projected from the projectors 0121, 0122, 0123, 0124 to be 
smoothly connected with least conspicuous seams on the screen with smooth brightness distribution. The worked-out 
parameters are sent through image correction control lines 0295 and loaded on the image correctors 0281 , 0282. 0283, 



[0023] Fig.3 shows the relationship between the maximum image projection ranges 0151. 0152. 0153. 0154 as 
shown in Fig. 1 and the projected images as processed by the image signal control unit 0110. The maximum image pro- 
jection ranges 0301. 0302, 0303, 0304 represent the areas of the maximum images that the-projectors 0121. 0122. 
0123. and 0124 can project on the screen 0140. respectively. The projectors 0121 , 0122. 0123. 0124 are positioned so 
30 that their maximum image projection ranges 0301 . 0302, 0303, 0304 overlap one another with overlap areas between 
neighboring projection ranges. 

[0024] The optimized image projection ranges 031 1. 0312. 0313, 0314, which are inside the corresponding maxi- 
mum image projection ranges 0301 . 0302, 0303, 0304. represent image display areas which enable the images pro- 
jected from neighboring projectors to look smoothly joined. 

35 [0025] Rg.4 is an enlarged view of one of the maximum image projection ranges shown in Fig. 1 . A maximum image 
projection range border 0401 indicates the range within which a projector can display an Image. An optimized Image 
projection range border 0402 shows the area to which the image supplied to the projector Is sized down so that Images 
projected from neighboring projectors look smoothly joined. The image signal control unit 0110 processes the input 
image signal so that the zone 0403 enclosed by the maximum image projection range tx)rder 0401 and optimized image 

40 projection range border 0402 has a pixel value which represents the darkest brightness. This prevents more than one 
projected Image from being displayed In this zone because it Is Included In the area where the neighboring projector 
can project an image. 

[0026] Fig.5 is a functional block diagram of an image corrector. An analog image signal is inputted through an 
image signal input terminal 0501 and converted by a video signal digitizer 0510 into digital data to be processed within 
45 the image corrector. The image data in the digitized form for each image frame is carried through an image data trans- 
mission line 0561 to a frame buffer block 0520 where It is stored. 

[0027] Geometric transformation and color correction parameters for the image are inputted through a conti-ol 
parameter input terminal 0502, carried through a control parameter transmission line 0567 and loaded into a geometric 
transformation block 0530 and a color transformation block 0540, respectively. In order to modify the output image 
so shape according to the loaded parameter data, the geometric transformation block 0530 loads, through an image data 
write address transmission line 0563, the address of a pixel to be outputted from an image signal output terminal 0503. 
calculates the address for the input image pixel to be outputted to that address, and sends the calculation result onto 
an image data read address transmission line 0565; and the corresponding input image pixel data stored in tiie frame 
buffer block 0520 is read out. 

55 [0028] The pixel data thus read is color-transformed by the color transformation block 0540 according to tiie preset 
parameter data and transferred to a video signal generator 0550. which then outputs It as a video signal. The algoritiim 
of operation of each functional block shown in Fig.5 is explained, referring to Fig.6 that shows the structure of the imple- 
mented functional blocks in Fig.5. as well as a PAD diagram. The video signal digitizer 0610 incorporates a signal split- 
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ter 061 1 as a means for splitting the input signal from an image signal input terminal 0601 into image color signal and 
synchronizing signal; an A/D converter 0612 as a means for quantization of image color signal voltage: and an address 
generator 0613 as a means for generating information on the position of a currently quantized pixel within the image. 
[0029] The frame buffer block 0620 consists of two frame memories A and B (0621 and 0622). a write address 

5 selector 0625, a read address selector 0626 and a read data selector 0627. The frame memories A and B each store 
image data for one frame and the write address selector 0625 selects which frame memory to be used for writing input 
pixel data and sends the write address and write timing to the selected frame memory. The read address selector 0626 
selects, as a read memory, the frame memory where data is not written, and sends the address of a pixel to be read to 
the selected frame memory, and the read data selector 0627 selects the pixel data sent from the read frame memory 

10 and outputs it. The geometric transformation block 0630 contains an address generator 0631 and an address displace- 
ment memory 0632. The address generator 0631 calculates which address in the frame memory chosen as a read 
memory should be used for output of the stored pixel data v^en the image corrector is going to output the pixel into a 
position within the Image. The address displacement memory 0632 stores all necessary parameters tor the calculation 
for each output pixel position. The color transformation block 0640 has a pixel data converter 0641 and a pixel data con- 

75 version parameter memory 0642, where the pixel data converter calculates pixel data to be oulputted by the Image cor- 
rector according to the pixel data read from the frame buffer block 0620 and the pixel data conversion parameter 
memory 0642 memorizes how pixel data conversion should take place for each output pixel position. 
[0030] The video signal generator 0650 has a D/A converter 0651 and a video signal synthesizer, where the D/A 
converter converts output pixel data into image color signal and the video signal synthesizer generates synchronizing 

20 signal based on pixel output position data and combines it with the image color signal for conversion Into video signal. 
Fig.7 shows the operational sequence for the video signal digitizer 0610. In step 0700. image signal is split into image 
color signal and synchronizing signal. In step 0701, image color signal is quantized. In step 0702, pixel address (pixel 
column and row data) is generated according to the synchronizing signal. 

[0031 ] The numeric image data thus quantized is once stored in the frame buffer block 0620. For the stored numeric 
25 Image data, the geometric transformation block 0630 generates read address for geometric transformation and the 
pixel data read undergoes color correction by the color transformation block 0640. 

[0032] Fig.8 shows the operational sequence for the frame buffer block 0620. Steps 0800 and 0801 are taken to 
choose one of the two frame buffer memories for reading and the other for writing. Instep 0802. waiting time is taken 
until data to be written at the write starting position in the top left corner of the saeen is supplied to the frame buffer 

30 block 0620. In step 0805, pixel data is written in the write frame buffer memory. In step 0806. pixel data is read from the 
read frame buffer memory according to the address sent from the geometric fansfbrmation block 0630. and transferred 
through the read data selector 0627 to the color transformation block 0640. Steps 0805 and 0806 are repeated until all 
pixels for a whole Image frame are written, and then step 0807 is taken to switch the functions of the write and read 
frame buffer memories. Then, the steps from 0805 are repeated. 

35 [0033] Fig. 9 shows the operational sequence for the geometric transformation block 0630. In step 0901 , a geomet- 
ric transformation vector table as shown in Fig. 10 is loaded into the address displacement memory 0632. 
[0034] The geometric transformation vector table is two<llmensional data composed of two-dimensional vectors 
which correspond to pixels In one frame of image on the basis of one vector for one pixel. In step 0903, the row and 
column data (x[r, c], y[r, c]) of tiie geometric transformation vector table stored in the address displacement memory 

40 0632 is read for each of tiie addresses (r, c) supplied In sequence from the video signal digitizer 0610. In step 0904. (r, 
c) + (x[r, c], y[r. c]) Is calculated and the result Is outputted as the read address for the frame buffer block 0620. Steps 
0903 and 0904 are repeated as far as re-initialization of the address displacement memory 0632 is not requested from 
the control parameter input terminal 0602. If such re-initialization is requested, the steps from 0901 are repeated again. 
[0035] Fig.1 1 shows the operational sequence for the color transformation block 0640. In step 1 101 , a color trans- 

45 formation parameter table as shown in Fig. 12 Is loaded into the pixel data conversion parameter memory 0642 and ini- 
tialized. The color transformation parameter table is two-dimensional data for three planes which consist of parameters 
as a result of approximation as N piecewise linear function of the respective transformation functions for the three color 
components (red, blue, green) of each pixel in one frame of image. In step 1 103, regarding each of the addresses (r, c) 
supplied in sequence from the video signal digitizer 061 0, color transformation parameters are read for each of the red, 

50 blue and green components at the address (row and column) of the color transformation parameter table in the pixel 
data conversion parameter memory 0642. If the intensity of each color component of tiie pixel outputted from the frame 
buffer block 0620 is expressed as "z", the intensities of the color components are transformed using a transformation 
equation (equation 1) and transferred to the video signal generator 0650 (step 1 104). 

55 
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[0036] Steps 1 103 and 1 104 are repeated as far as the control parameter input terminal 0602 does not request re- 
initialization of the pixel data conversion parameter memory 0642. If such request is made, the steps from 1101 are 
repeated. 

[0037] TTie pixel data supplied from the color transformation block 0640 is converted into analog video, signal by 
75 the video signal generator 0650 and outputted through the image signal output terminal 0603. Parameter data to be 
loaded into the geometric transformation block 0630 and color transformation block 0640 as shown in Figs.10 and 12 
is created by the image correction parameter generator 0290 according to the state of the image on the screen 0140 
as monitored by the screen state monitor camera 0130. The geometric transformation parameter as shown in Fig. 10 is 
calculated as follows. 

20 [0038] A pattern for correction as shown in Fig. 13 is projected from the projectors through the image correctors 
0281 , 0282, 0283, 0284 onto the screen and the projected image is photographed by the screen state monitor camera 
0130 and an apex 1301 or similar point is chosen as a characteristic point in the image. Assuming that as for a charac- 
teristic point like this, position coordinates q in the camera coordinate system can be correlated with coordinates p in 
the frame memory of the pixel corresponding to that point, position coordinates p in the coordinate system of the frame 

25 memory corresponding to an arbitrary point q in the camera coordinate system for an area where no such pattern is 
displayed can be calculated as follows. Regarding q_1 . q_2 and q_3 as three points near q, the points that correspond 
to coordinates p_1 . p_2 and p_3 in the frame memory coordinate system are calculated. Then, if the relation between 
q. and q_1 . cl.2. q_3 is expressed by equation 2 which uses appropriate real numbers a and b. p can be represented 
by equation 3. 

30 

q = Qc+a(Qa-Qc)+^(Qb-Qc) [eq. 2] 

p = p^+a{p^-p^)+b{Pt,'Pc) [eq.3] 

35 [0039] As shown in Fig. 14. if the maximum image projection ranges 1401. 1402. 1403. 1404 of the four projectors 
overlap one another, the coordinates of the apex 1421 (of the maximum image projection range 1402 of an adjacent 
projector B) which exists within the maximum image projection range 1401 of projector A are read as coordinates in the 
frame memory coordinate system of the image corrector connected to projector A, using the above-mentioned coordi- 
nates transformation method. In other words, it is possible to d^ine an isomorphism T_{AB} which correlates coordi- 

40 nate value x_B of an arbitrary point on the screen, in the frame memory coordinate system of the image corrector 
connected to projector B, with coordinate value x_A in the frame memory coordinate system of the image corrector con- 
nected to projector A. 

[0040] Therefore, the coordinate values of an arbitrary position within the projected image discussed below are 
assumed to be coordinate values in the frame memory coordinate system of the image corrector connected to one of 
45 the projectors. Here, the maximum image projection ranges of two neighboring projectors which border on each other 
horizontally or vertically are represented by S_A and S_B, respectively and the partial border lines in this adjacent area 
which should border on each other are represented by B_{AB) arxi BJBA) respectively. 

[0041] In Fig. 14, these partial border lines correspond to. for example, the partial border line 1413 of the maximum 
image projection range 1401 with apexes 141 1 and 1412asend points and the partial border line 1423 of the maximum 
50 image projection range 1402 with apexes 1421 and 1422 as end points. Partial border lines B_{AB} and BJBA) are 
expressed as point-sets by equations 4 and 5. 

{bABO)\te /0.17) [eq.4] 

55 IbgAiOlte [0.^}] [eq.5] 

[0042] In border lines B_{AB} and B_{BA}. the segments which are included in or border on the adjacent maximum 
image projection range are called effective partial tx>rder lines. Here, the respective border line segments are defined 
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by equations 6 and 7 as follows. 



10 
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20 



...[eq.6] 



.(eq.7] 



where a_{AB} and P_{AB} In equatbn 6 are defined by equation 8 for the four ceises as shown in Table 1 . 



Table 1 



Case 1 


bAB(t) does not intersect with Bba- and Bba+- 


Case 2 


bAsO) intersects with Bba+ at bAB(c). bAB(0) € Sb 


Case 3 


bAsO) intersects with Bba- a* bAB(c). bAB(1) ^ Sb 


Case 4 


^abW intersects with Bba- at bAB(cO) and with Bba+ at bAB(cl). where cO < c1. 



25 



30 



(0,0 


: easel 


(0.C) 


:case2 








:case4 



..Ieq.8] 
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40 



[0043] a_{BA} and p_{BA} are defined in the same way as above. 

[0044] The four cases for equation 8 correspond to the four types of overlap of neighboring two maximum image 
projection ranges as shown in Fig. 15, where the upper partial border line and lower one which join the partial border 
line B_{BA} of range B, are represented by B_{AB-} and B_{AB+}, respectively. 

[0045] Including the possibility that the adjacent maximum image projection range S_B is empty, there are four pos- 
sible states of partial border line end point bJAB} (a) (ae {0. 1} as shown in Table 2. 



Table 2 



Case a 


Ideally, bAB(a) should be in the border area of four maximum image projection ranges Sa. Sb, Sq and Sq 


Casep 


Ideally. bAB(a) should be in the border area of two maximum image projection ranges Sa and Sb- 


Casey 


Sb is empty and its adjacent range Sc where bAB (a) =bAC " a), is not empty. 


Case 5 


Sb is empty and its adjacent range Sc- where bAB (a) = bAc 0 - a), is empty. 



[0046] Here, the destination point. e_{AB} (a), to which the border line end point b_{AB} (a) moves, is defined by 
equation 9. 

55 



BNSOOCID: <EP 1039749A1J > 



7 




EP 1 039 749 A1 



batycenter of S^^ Sg f\ r\ Sj, cased 



10 



[0047] In equation 9. b_{AB} (1 - a) corresponds to A_1 b_{AB}{1 • a) = 0 in case 6. while it is as defined by equa- 
tions 10 and 11 in the other cases. 



15 



[eq.lO] 



P(r.s)^^-^s [eq. 11] 

20 

b_{AC} (a) corresponds to A_2 b_{AB} (a) = 0 in case 5. while it is as defined by equation 12 in the other cases. 

Asia) = Pie^^(a)-b^aialb^Q(^•ayb^B{a)) [eq. 12] 
25 [0048] The effective partial border line end point movement vectors are defined by equations 13 and 14. 

^AB^a) = e^Q{a)-b'^{a) [eq.13] 

ofe^(a) = e BA^ayb' B^{a) [eq.14] 

30 

where a=0 or a=1 . The movement direction vectors of the entire effective partial border line are defined by equa- 
tions 15, 16 and 17. 

^AB^n = /(c^>is(0),cy^(1):0 [eq. 15] 

35 

dBAi^) = l(dsA^Plds,,(^y^) [eq. 16] 

l^p^q-.n^i^-npUq [eq.17] 

40 [0049] Subsequently, using the solution of the vector equation with regard to A(t) and B(l -t) in equation 1 8, shared 
border lines GJAB} and G_{BA} corresponding to partial border lines B_{AB} and B_{BA} are defined by g JAB}(t) and 
g_{BA}(t) in equations 19 and 20. 

b^AB^^y^^W^AsW = i>'s>^0-0+S(l-OG^e>*0-0 [eq- 18] 

45 

9ab0) = b'As{t)+A{t)d^{t) [eq. 19] 

9BAiO = b'BA(t)+B(t)dBA{t) [eq. 20] 

50 [0050] In the example shown in Fig. 14. 1430 represertts the shared border line with regard to the partial border 
lines 1 413 and 423 of the maximum image projection ranges of projectors A and B. A range enclosed by shared border 
lines as calculated in this way is called an optimized image projection range; 1441, 1442, 1443. 1444 in Fig. 14 are opti- 
mized image projection ranges. 

[0051] Here, the partial border lines of maximum image projection range S_A which should coincide with the partial 
55 border lines of the four projection ranges S_B. S_C. S_D and S_E adjacent to S_A are represented by BJAB). B_{AC}. 
BJAD) and BJAE}, respectively. 

[0052] The shared partial border line with regard to BJ AX} (xe {B, C. D, E}) is expressed as G JAX} and defined by 
equation 21. 
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GAx-lQAx(WelO^]} [eq.2l] 

[0053] The range enclosed by border line =SG_{AX}$ is called an optimized image projection range for the maxi- 
mum image projection range S_A, and expressed as Q_A. 
£ [0054] T_A : S_A ^Q_A. which denotes image transformation from maximum image projection range S_A to opti- 
mized image projection range Q_A, is defined as follows. 

[0055] First, isomorphism from S_A = [0. 640] x (0, 480] to D_2 = [0. 1] x [0, 1] is expressed as 7i_A and defined by 
equation 22. 

10 n^(A'.y) = (x/640.y/320) [eq. 22] 

[0056] Next, isomorphism from Q_A to D_2; expressed as ^ _A, is defined by equations 23. 24. 25 and 26 with 
respect to dQ_A. 

15 ^A(9ABin)-{t.O) [eq.23] 

^a(9acO)) = (U) [eq.24] 

?4(5>*d(0) = (1-M) [eq.25] 

^A(QAE(0)-(0^'t) [eq.26] 

[0057] Here, continuous transformation ^ : D_2 ->E_2 with respect to 3 D_2 Is defined by equation 27. where E_2 
represents two-dimensional vector space. 

4> ^(y . \/) = ^A (u.vyn {u. V) [eq. 27] 

[0058] Then. ^ (u. v) within D_2 Is defined by equation 28. 



20 



25 



30 



35 



^Ai^*^) = a/(*4(i/.0).«|>^(u.1);v)). /(<|) ,^(0. vU^ (1 . V): p( j//p( [eq- 28] 

where p (x) denotes a continuous function, which is zero if x=0 or x=rl . and defined, for example, by equation 29. 

p(x) = x(1-x) [eq.29] 

[0059] Here, T_A : S_A Q_A for geometric transformation is defined by equation 30. 

40 {X) = (t> ^ ( Ji(x))+x [eq-30] 

[0060] Furthermore, the elements of the geometric transformation vector table in Fig. 1 0 are generated by transfor- 
mation vector function U_A as defined by equation 31. 



45 



so 



T'Hx)-x 'x£Q^ 

M ^ .,.[cq.311 

n : otherswise 



[0061] Fig. 16 shows the control data generating sequence for geometric transformation in the image correction 
parameter generator 0290, 

55 [0062] In step 1600. geometric transformation parameters for image correctors 0281. 0282. 0283. 0284 are set to 
zero. For each projector, the steps explained below. 1602. 1603, 1604. 1605 and 1606. are carried out. In step 1602. 
an image of the pattern as shown in Fig.1 3 is projected at the maximum size on the screen. In step 1 603, the projected 
image in step 1602 is photographed by the screen state monitor camera 0130. In step 1604, the points corresponding 
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to the apexes of the checkered pattern in Fig.13 are read with respect to the camera coordinate system from the shot 
taken In step 1604. In step 1605, the characteristic point position coordinates are transformed to match the coordinate 
system of the image corrector frame memories. In step 1606. the geometric transformation vector generating sequence 
as shown in Fig. 17 is executed. 
5 [0063] Fig. 17 shows the geometric transformation vector generating sequence. In step 1700, the point set on the 
border lines of the maximum image projection ranges defined by equations 4 and 5 is produced. In steps 1701 and 
1 702. effective partial border lines are calculated. In step 1 703. the points to which the effective partial border line end 
points move are worked out. In step 1 704. the end point movement vectors for the effective partial borders line are cal- 
culated. 

10 [0064] In step 1 705. the movement direction vectors for the effective border lines are worked out. In step 1 706. the 
border lines of optimized image projection ranges are calculated. In step 1707, geometric transformation control param- 
eters for the entire maximum image projection ranges are calculated. 

[0065] The color reproduction quality of projected images varies from one projector to another and also depending 
on in which position on the screen the image Is projected. The function of the color translbrmation block 0540 of each 

75 image corrector is to suppress these two types of variation and control the color reproduction quality so that the pro- 
jected images from two neighboring projectors join end to end smoothly. The sequence for generating pixel data con- 
version parameters to be loaded into the color transformation block 0540, as shown in Fig. 12. is explained next. 
[0066] Here, on the above-said shared border lines included In the overlap area of the maximum image projection 
ranges of neighboring projectors $A$ and $B$. it is assumed that if z represents the color component value in displayed 

20 image data corresponding to the position where both the images should coincide ideally, f_X(2) represents the color 
component value as measured by the screen state monitor camera 01 30 with respect to z, where X denotes A or B. 
[0067] Hence, optimized color component function $g(z) $ is defined by equations 32 and 33. 



25 



Q{z) = (Yh - y JL(/i(z):/?(Zo).A)(Z;v))+y^ [eq. 32] 

= [eq.33] 

30 [0068] Here, y_H, y_L and h(z) are defined by equations 34. 35 and 36, respectively. 

y„ = min(/^(z„).fB(z„)) [eq. 34] 

35 ="iax(/^(z^)./e(z^)) [eq.351 

f.(z),/o(z) 

h{z)= [eq.36] 

40 

[0069] The function C_X(z) for color junction on the border line is defined by equation 37. 

p(z) = /^(C^(z)) [eq.37] 

45 [0070] This color junction function C-X(z) is approximated as an N piecewise linear function expressed by equation 
1 . In this case, the parameter for the l-th segment of the N piecewise linear function Is given by equation 38. 

{z^.f^igiZf))) [eq.38] 

so [0071] The color junction function for each point on the shared border line is defined in the above-mentioned way. 
Supposing that the color transformation function for each point (u, v) within D_2 Is represented by C-.{X[u. v]} (z). the 
parameter data on the border line as defined by equation 38 Is used to define the parameter data for the entire D_2 area 
using equation 39 in the same way as equation 28. 
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[0072] Then, the color junction function iL_{X[x. y]} (z) for a position (x. y) in the maximum image projection range 
is defined by equation 40. 



10 



so 



1 Q : otherwise 



[0073] The ptecewlse linear approxinnate parameter for the defined rL.{X[x. y]} (z) is considered as the pixel data 
conversion parameter for a position (x, y) within the maximum image projection range. 

[0074] Fig. 18 shows the pixel data conversion parameter generating sequence in the image correction parameter 
15 generator 0290. In step 1800, parameters appropriate to identity transformation are loaded as defaults. The steps 1802 
through 1807, explained below, are performed for each projector. Step 1802 is a step to control the repetition of steps 
1803 through 1806 for each sample point on tiie border line of the optimized image projection range. In step 1803» the 
brightness of each color component is measured. In step 1804, N piecewise linear approximate function for the meas- 
ured color component, f_X, is calculated. In step 1805, the optimized color component function is calculated. In step 
20 1806, pixel data conversion parameter on the border line is calculated. In step 1807, pixel data conversion parameter 
for the entire optimized image projection range is calculated. 

[0075] This embodiment produces an effect that neighboring projected images join end to end precisely without any 
gaps or overlaps, and color discontinuity at the joint of the two images can be eliminated. Further, the required amount 
of image reshaping and the required pixel color transformation function are automatically calculated, which relieves the 
25 operator from the drudgery of manual repositioning of projectors and color adjustments. 

[0076] As described next, a second embodiment of this invention has the same structure as the first embodiment 
except that the functionality of the image splitter 0250 as shown in Fig.2 and tiie metiiods for calculating geometric 
transformation control parameters and pixel data conversion parameters are different. 

[0077] As shown in Fig. 19. the image splitter 0250 splits the image 1901 from the input image signal into partial 
30 images 1911 , 1912, 1913, 1914 tiiat each have a given amount of overlap with the other adjacent partial images, and 
generates image signals corresponding to these partial images. 

[0078] The ratio of overlap width (W) to image length (L), W/L. is set to a ratio smaller than that of neighboring max- 
imum image projection ranges. Conversely speaking, when this ratio W/L is set so. the projectors 0121. 0122. 0123, 
0124 are positioned and angled so that the ratio of overlap of maximum image projection ranges 0151. 0152. 0153. 

35 01 54 is larger than the ratio of overlap of partial images W/L. 

[0079] The area in each partial image which is enclosed by dividing centerlines 1921 and 1922 is called a major 
divisional area. In Fig. 19. tiie hatched areas 1931, 1932. 1933. 1934 are major divisional areas. 
[0080] In tiiis embodiment, tiie border lines of the major divisional areas 1931 . 1 932. 1933. 1 934 are substituted for 
the partial border lines defined by equations 4 and 5 in geometric transformation control parameter calculation as used 

40 in the first embodiment. Since geometric transformation T for points in the major divisional areas can be calculated 
using equation 30 as in the first embocfiment. geometric transformation control r>arameters are calculated using equa- 
tion 31 . Calculation of geometric transformation control parameters for areas outside the major divisional areas is made 
as follows. 

[0081] In neighboring partial images A and B as shown in Fig.20. it is supposed that the areas which overlap each 
45 other are represented by C_{AB} and C_{BA}, and the non-overlap areas by F_{AB} and F_{BA}. The C_{AB} and 
C_{BA} are each divided by the dividing centerlines 2001 and 2002 into two parts,, which are expressed by equations 
41 and 42, respectively. 



Oba-^ba^^ba feq.42] 



[0082] Here. E_{ AB} and E_{BA} each represent the sides of the overlap areas C_{AB} and CJBA) (divided by the 
dividing centerlines 2001 and 2002) tiiat border on F_{AB} and F_{BA}. respectively. Hence, the major divisional areas 
55 of the partial images A and B are expressed as E_{AB} u F_{AB} and EJBA} u F_{BA}. respectively 

[0083] As indicated in the explanation of tiie first embodiment, 4'_{AB}. a function for transforming coordinates in 
the coordinate system of ttie partial image B into those of the partial image A. and its inverse function 4^_{BA} can be 
defined. Hence, the composite function V_{AB} to be defined on D_{AB} is defined by equation 43 using the geomef ic 
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transformation function T_B for the partial image B as defined on B_{BA} u F_{BA} by equation 30. 

^a(^) = ^>»e(7"fi{^s4(^))) [eq. 43] 

[0084] A transformation vector function equivalent to equation 31 . U_A, is defined by equation 44. 

Ua U) = W ^ ^ : ^ € . ..[eq. 44] 

0 : otherwise 



[0085] Next, pixel data conversion parameters are calculated with the following procedure. First, for each point in 
the overlap area CJAB}. the piecewise linear function defined by the parameter indicated in equation 38 is used to 
define the pixel data conversion function, as in the first emtxxiiment. 

=^^AX [eq.45] 



[0086] Then, regarding all neighboring partial images X, in the inside of F_A, an area which does not overlap any 
adjacent partial image, as expressed by equation 45, the pixel data transformation function is defined by interpolation 
25 with equation 39 using the pixel data conversion function as defined on the border as mentioned above. Thus, pixel data 
conversion function ii_{A [x. y]} (z) can be defined by equation 46. 



[0087] Here, weight function kJA} (x. y) is defined by equation 47 and is the product of o_{A} (x, y) with regard to 
all partial images X adjacent to the partial image A. 



40 

[0(^] a_{A} (X, y) is a function defined on CJAB} that has a value as shown In Fig.21 at point x(t) on line 2010 
vertical to the dividing centerline 2001 as shown in Fig.20 and a constant value in the direction parallel to the dividing 
centerline 2001. 

[0089] As discussed above, the second embodiment is different from the first embodiment in the functionality of the 
45 image splitter 0250 as shown in Fig.2 and the metiiods for calculating geometi-ic transformation control parameters and 
pixel data conversion parameters. 

[0090] According to the second embodiment, the overlap area of neighboring partial images is transformed into an 
image which gradually disappears from the inside toward the outside and their overlap areas with this same image char- 
acteristic are optically laid one upon another on the screen, so the influence of partial image alignment error is exhibited 

50 as a blur in the joint between them. 

[0091] On the other hand, in case of the first embodiment, the influence of partial image alignment error appears 
as a discontinuous or non-gradual change in the image joint. Since due to the characteristics of the human sight, human 
beings are more sensitive to discontinuous image variation tiian to continuous image variation like blurs, the influence 
of image alignment error in tiie second emtxxliment is less perceivable to the human eyes than that in the first embod- 

55 iment. 

[0092] A third embodiment of this invention has tiie same structure as the first embodiment except that the Internal 
structure of the image signal control unit 01 10 as shown in Fig.2 and the functionality of the projectors connected to it 
are different. Referring to Rg.22, tiie third embodiment is explained next. 
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[0093] In the third embodiment, each of projectors 2201. 2202. 2203, 2204 incorporates an image corrector with 
the same functionality as explained for the first embodiment. In addition, the projectors are connected with two types of 
input signal lines: image signal lines 2241 , 2242. 2243, 2244 and control signal lines 2231 . 2232. 2233. 2234. 
[0094] Like the first embodiment, the third embodiment also produces such an effect that neighboring projected 
5 images can join end to end without any gaps or overlaps. 

[0095] A fourth embodiment of this invention is described next, referring to Fig.23. The fourth embodiment employs 
a non-planar screen. 

[0096] A curved surface screen 2300 is used to enable projected images to efficiently cover the visual field of the 
viewer. Usually, if images are projected on a curved screen surface from projectors designed for projection on a planar 
10 screen, projected images will be rectangles whose sum of vertex angles is larger than 360 degrees, as illustrated here 
by maximum image projection ranges 2321 and 2322. Therefore, normally it is impossible to let the neighboring maxi- 
mum image projection ranges 2321 and 2322 join end to end without any gaps or overlaps. 

[0097] Projectors 2301 and 2302 are positioned so that the adjacent side of one of the two neighboring neximum 
image projection ranges 2321 and 2322 is included in the other's projection range as shown in Fig. 19, and image sig- 
75 nals to the projectors 2301 and 2302 are controlled using the image signal control unit 2310 having the same function- 
ality as explained for the first embodiment so that the neighboring projected images fit the optimized image projection 
ranges 2331 and 2332. 

[0098] Explained below is a fifth embodiment of this invention which uses an image signal control unit 01 10 similar 
to the one as described for the first embodiment, which, however, does not have image correctors 0281, 0282, 0283, 

20 0284 as used in the first embodiment. The functional block diagram of the image signal control unit of the fifth embodi- 
ment is shown in Fig.24. The image signal control unit has, as input/output terminals, partial image input terminals 
2421 . 2422, 2423, 2424. an input terminal 2430 for the screen state monitor camera, and partial image output terminals 
2441. 2442. 2443. 2444. The image signal selector 2460 selects either image signals from the partial image input ter- 
minals or image signals from the test pattern generator 2470 and supplies the selected signals to the partial image out- 

25 put terminals- The respective partial image signals are supplied by image reproduction units 2451 . 2452, 2453. 2454 
(connected to the partial image input terminals) that reproduce images from visual media such as DVD-ROMs. 2491 , 
2492. 2493. 2494. which store image data to be dealt with by the respective projectors. 

[0099] The image signal control unit as shown in Fig.24 requires no image correctors. As mentioned earlier, due to 
such factors as the configuration of the SCTeen, the positional relationship between projectors and the screen and the 

30 display characteristics of the projectors, image geometric transformation and image color characteristic transformation 
are necessary in order to join images projected from the projectors smoothly. The first embodiment is designed to per- 
form such image correction in real-time by means of hardware. In the fifth embodiment, however, pre-con^ected image 
data for partial images to be dealt with by the respective projectors are stored in visual media like DVD-ROMs. The 
image reproduction units 2451, 2452. 2453, 2454 realize smooth image connection simply by providing pre-corrected 

35 image data to the projectors. Thus, image correctors are unnecessary according to the fifth embodiment of the inven- 
tion. 

[0100] Next, a sixth embodiment of the invention is explained. The sixth embodiment uses image reproduction 
processors with image correction functionality as shown in Fig.25 instead of the Image reproduction units 2451 . 2452. 
2453, 25454 in the fifth embodiment. 

40 [0101] As shown in Fig.25. the sixth embodiment uses a different projector array system from that of the fifth 
embodiment. In the sixth embodiment, each image reproduction unit consists of the following: a pickup 2521 which 
loads image data from an image data storage medium 251 1 ; an image reproduction circuit 2531 which decodes the sig- 
nal detected by the pickup into image data; an image correction circuit 2532 which processes the image reproduction 
data according to image correction data inputted from an image correction data input terminal 2551; a medium 2541 

45 which stores the processed image data; and an image storage/reproduction circuit 2533 which reads the processed 
image data from the temporary storage medium 2541 and sends it to an image output terminal 2552. 
[0102] While the fifth embodiment cannot cope with such a case that the amount of image correction required for 
smooth image connection varies among individual projector array systems, the sixth embodiment solves the problem 
by enabling optimal image correction for each projector array system using the following sequence: the image correc- 

50 tion circuit 2532 pre-corrects partial image data for each projector offline and the corrected image data is once stored 
in the temporary storage medium 2541; the stored corrected image data is read out from the temporary storage 
medium 2541 to realize smooth image connection on the screen. 

[0103] According to the sixth embodiment, it is possible to join images end to end smoothly on the screen even if 
an image correction circuit which is too slow to perform real-time image correction, or software-based image processing 
55 emulation is used, while the first embodiment requires a processor for real-time image correction to realize smooth 
image connection. In addition, if the required amount of image correction differs among individual projector array sys- 
tems, while the fifth embodiment is unable to join images on the screen properly, the sixth emt>odiment solves the prob- 
lem by using the optimal amount of image correction for each projector array system. 
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[0104] According to these embodiments, images projected on a curved-surface screen can be smoothly joined. 
[0105] Also, for maximum image projection ranges of neighboring projectors on said screen to overlap each other 
at least by a given amount, input image data which has been subjected to adequate geometric and color transformation 
is supplied to the projectors. This makes it possible to join projected images from several projectors smoothly with least 
5 conspicuous seams and to form a single whole picture on the screen, making precise positional and optical adjustments 
of projectors unnecessary. 

[0106] Since means for performing real-time geometric and color transformation of image data depending on pro- 
jector and screen characteristics are provided, smooth connection of projected images from several projectors to form 
a single picture can be realized just by controlling the image transformation means. To cope with variation in projector 
10 positions and optical system adjustments, this invention only takes the approach of signal processing, tiiereby eliminat- 
ing the need for optical and mechanical control means which would be more costiy and more difficult in improving con- 
trol accuracy than means for signal processing circuit control. As a result, the invention offers the advantage that a less 
costiy. highly reliable multi-projection image display device can be realized. 

[0107] Another advantage of the invention is to ensure cost reduction and improved accuracy in image adjustment 
15 work in comparison with conventional human visual inspection and manual adjustments, since the invention provides 
means to automatically control image transformation means by automatic calculation of required amounts of image 
geometric and color transformation for smooth connection of projected images from several projectors to form a single 
picture. 

[0108] In addition, the theme of joining projected images from several projectors smoothly to form a single image is 
20 achieved by optical addition of rays of light from neighboring projectors so as to connect the overlap and non-overlap 
areas of neighboring projected images smoothly. This means that the influence of projector positioning errors or image 
geometric transformation means control errors appears as image blurs. Therefore, an advantage of the invention Is to 
be able to make Image defects as caused by such errors less conspicuous to the human eyes due to the fact that the 
human eyes are less sensitive to continuous image variation such as blurs than to discontinuous Image variation 
25 because of the characteristics of the human sight. 

[01 09] If a projector incorporates an Image data converter capable of performing at least geometi-ic and color char- 
acteristic transformation of digitized image signal data based on input image signals, and an arithmetic control unit for 
controlling said image converter, it is possible to offer not only tiie same advantages as the multi-projection image dis- 
play device as mentioned above, but also a further advantage: when each of said projectors is used as a separate unit, 
30 geometric transformation and brightness distribution alteration can be made on a projected image and even if the opti- 
cal axis of the projector is not vertical to the screen, an image with an accurate image shape and precise brightness 
distribution can be reproduced on the screen. This lightens restrictions on the positional relationship between the 
screen and projector. 

35 Industi-ial Applicability 

[0110] According to this invention, several Images (data) can be joined to form one picture (or pictures) by the use 
of a relatively simple image display device, and joints of neighboring images can be made less conspicuous. 
[01 1 1 ] As discussed so far, the invention enables projected images from a plurality of image projectors to be joined 
40 and displayed as one picture (or pictures). 
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Fig.6 

0621 Frame memory A 

0622 Frame memory B 

5 0625 Write address selector 

0626 Read address selector 

0627 Read data selector 
0612 A/D converter 

061 1 Signal splitter 
10 061 3 Address generator 

0631 Address generator 

0632 Address displacement memory 

0641 Pixel data converter 

0642 Pixel data conversion parameter memory 
15 0651 D/A converter 

0652 Video signal synthesizer 

Fig.7 

Video signal quantization 
0700 

Analog image signal is split into image color signal and synchronizing signal by signal splitter 061 1 . 
0701 

Image color signal is quantized by A/D converter 0612. 
0702 

According to separated synchronizing signal, horizontal and vertical positions of currently quantized pixels are 
calculated by address generator (0613) and output as pixel addresses. 

Fig.8 

Frame buffer write/read sequence 
0800 

One of the frame memories Is chosen as a write memory by write address selector 0625. 
0801 

The other frame memory is chosen as a read memory by read address selector 0626. 
0802 

Waiting for write address selector 0625 to give an address to indicate the frame top position. 
0803 
Repetition 
0804 

Until writing of all pixels for one frame is finished 
0805 

Input pixel data is written at the address supplied to write address selector 0625 in the write frame memory. 
0806 

Pixel data is read out from the output address of geometric transformation block 0630 on the read frame mem- 
ory and transferred through read data selector 0627. 
0807 

The write and read frame memories switch their functions. 
so Fig. 9 

Geometric transformation 

0900 

Repetition 
55 0901 

Geometric transformation vector table is read into address displacement memory 0632 through control param- 
eter input terminal 0602. 
0902 
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Unless re-initiatization of address displacement memory 0632 is requested 
0903 

Geometric transformation vector data (x[r, c|, y[r. c]) at each input address (r. c) in address displacement mem- 
ory 0632 is read. 
5 0904 

Address generator 0631 calculates and outputs (r, c) + (x[r, c], y[r, c]). 

Fig. 10 
Fig. 11 

10 

Color transformation 
1100 

Repetition 
1101 

15 Color transformation parameter table is read through control parameter input terminal 0602 into pixel data con- 

version parameter memory 0642. 
1102 

Unless re-initialization of pixel data conversion parameter memory 0642 is requested 
1103 

20 Color transformation parameter [(P'r^c* ^nc) I' = 0,...N) for each of red, blue and green components at each 

input address (r. c) in pixel data conversion parameter memory 0642 is read. 
1104 

Pixel data converter 0641 transforms the intensity of each color component outputted from frame buffer block 
0620 using eq.1 and outputs it to video signal generator 0650. 

25 

ng-12 

Fig. 13 
Fig. 14 
Rg.i5 
30 Fig. 16 

Geometric transformation control data generation 
1600 

Geometric transformation parameters for image correctors 0281 , 0282, 0283, 0284 are set to zero. 

35 1601 

For each projector 
1602 

Test pattern generator 0270 and image signal selector 0260 are controlled so that the image signals for the pat- 
tern shown in Fig. 13 are supplied to the respective projectors through image correctors 0281, 0282. 0283. 
40 0284 for projection on saeen 0140 at the maximum output size that the projectors can handle. 

1603 

The image state on screen 0140 is photographed to be read as image data by screen state monitor camera 

0130. 

1604 

45 The read image data is processed to determine the coordinates of positions of characteristic points in the pat- 

tern. 
1605 

Positional coordinates of characteristic points are converted into data in the frame memory coordinate system 
using eqs. 2 and 3. 
so 1606 

Geometric transformation vector generation 

Fig. 17 

55 Geometric transformation vector generation 

1700 

Point-set on border lines, as defined by eqs. 4 and 5. of maximum image projection ranges is produced by lin- 
ear interpolation based on positional coordinates of characteristic points on border lines of projected images 
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from the projectors. 
1701 

Border line intersections of neiglt>oring ranges are calculated from the point-set on border lines of maximum 
image projection ranges. 
5 1702 

Effective partial border lines as defined by eqs. 6 and 7 are calculated from t)order line Intersections. 
1703 

Points to which effective partial tx)rder line end points move are calculated using eq.9. 
1704 

10 End point movement vectors for effective partial border lines are calculated using eqs. 13 and 14. 

1705 

Movement direction vectors for effective partial tx)rder lines are calculated using eqs. 15 and 16. 
1706 

Border lines of optimized image projection ranges are calculated using eqs. 19 cind 20. 
15 1707 

Geometric transformation control parameters for the entire maximum Image projection ranges are calculated 
using eq.31. 



20 



Fig.18 



Pixel data conversion parameter generation 
1800 

N piecewise linear function parameters appropriate to identity transformation are loaded on image correctors 
0281 . 0282, 0283, 0284 as pixel data conversion parameters. 

25 1801 

For each projector 
1802 

For each sample point on border line of optimized image projection range 
1803 

30 Colors with brightness levels graduated in (N + 1) steps, into which the whole (minimum to maximum) bright- 

ness range of each color component Is equally divided, are projected in sequence and the color brightness lev- 
els on the screen are measured. 
1804 

N piecewise linear approximate function for the measured color component. fX(z), is calculated. 
35 1805 

Optimized color component function g{z) is calculated using eq. 32. 
1806 

N piecewise linear function parameter as defined by eq.38 is calculated from optimized color component func- 
tion g{z) and measured color component function fX[z), 
40 1807 

Color transformation function iiX[x. y] for the entire optimized image projection range is calculated using 
eq.40 to find an appropriate N piecewise linear approximate parameter. 

Fig- 19 
45 Fig.20 
Fig.21 
Fig.22 
Fig.23 
Fig.24 

50 

Pattern generator 

Fig.25 

55 Image reproduction circuit 

Image correction circuit 
Image storage/reproduction circuit 
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Claims 

1 . An image display methcxj which is used in a multi-projection image display device having a plurality of image output 
units, characterized in that: 

5 

on a display screen onto which said image output units project images, the image projection range of one of 
said image output units overlaps that of another one of said image output units; and 
mutually correlated images are oulputted from said image output unit and said other image output unit to the 
overlap area on the screen. 

10 

2. The image display method of claim 1 , characterized in that said correlated images are the same in content as the 
images which are respectively projected from said image output unit and said other image output unit. 

3. The image display method of daim 2, characterized in that images with the same content are displayed as over- 
is lapped each other. 

4. The image display method of claim 2, characterized in that said images with the same content are displayed in a 
way that outputs from said image output unit and said other image output unit conform to the content displayed in 
areas other than said overlap area. 

20 

5. The image display method of daim 4, characterized in that the display is made, conforming to the color of the dis- 
play in areas other than said overlap area. 

6. The image display method of claim 1 , characterized in that said image output units project images on a saeen. 

25 

7. The image display method of daim 1 , characterized in that a plurality of said image output units display the content 
for one picture on said display screen. 

8. A multi-projection image display device which forms more than one display on a screen, characterized in that it 
30 incorporates: 

image projectors for projecting images on said screen; and 

a control unit which, if the display range of projected image from one of said projector includes an area which 
overlaps that from said other projector, enables mutually correlated images to be outputted from said projector 
35 and said other projector onto said overlap area on the screen, respectively. 

9. The multi-projection image display device of claim 8, characterized in that said control unit enables light from a plu- 
rality of said projectors to be cast in optically added form on said overlap area of said saeen. 

40 10. The multi-projection image display device of claim 9. characterized in that said control unit incorporates: 

data converters having the function of performing at least geometric transformation and color display charac- 
teristic transformation accoiding to the characteristics of said projectors and said screen; and 
an arithmetic control unit for controlling said data converters. 

45 

11. The multi-projection image display device of claim 10. characterized in that a means for photographing images pro- 
jected on said screen is provided and, within said arithmetic control unit for controlling said data converters, posi- 
tions on said screen are correlated with coordinates in the coordinate system representing pixel positions of the 
respective projected images from said image projectors according to image information based on shots made t>y 

50 said photographing means. 

12. The multi-projection image display device of daim 10. characterized in that said control unit converts image data 
so as to ensure that images formed in said overlap area by optical addition of rays cast from said projectors have 
the same image quality as images formed in areas other than said overiap areas of image projection ranges of said 

55 image projectors. 

13. An image projector for projecting images on a screen, characterized by having: 



BNSDOCID: <EP 1039749A1 J_> 



18 




EP 1 039 749 A1 



a data converter which performs at least geometric transformation and color characteristic transformation for 
digitized image signal data based on input image signal to said projector; and 
an output unit for output of data converted by said data converter. 

5 14. A storage medium characterized by storing image data In such a divided form as to make it correspond to individual 
image output units so that an image output unit and another one can output mutually correlated images onto areas 
where images from a plurality of image output units overlap. 

1 5. The storage medium of claim 1 4. characterized in that said divided image data undergoes image processing appro- 
w priate to the corresponding image output units. 

16. A computer-readatsle storage medium, characterized by 

storing a program by which the display area of an image projected from one of said image output units overlaps 
15 that from another image output unit; and 

mutually correlated images are outputted from said image output unit and said other Image output unit onto the 
overlap area, respectively. 

17. An image signal regenerator having: 

20 

a storage medium which stores image data in such a divided form as to make it correspond to individual image 
output units so that an image output unit and another one can output mutually correlated images onto display 
areas where images from a plurality of image output units overlap; and 

a supply unit which supplies image signals based on Image data read from said storage medium to the Image 
25 output units. 

18. An image projection method, wherein, for a plurality of projectors which project images on a screen from the front 
or back of the screen, an image signal for a partial image to be dealt with by each projector Is cut out or generated 
from the image signal supplied to the projector; and the generated image signal is processed to perform geometric 

30 transformation and local color correction for the image to be projected. 
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FIG.1 
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FIG.3 



0302 



0301 




0303 



0304 
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FIG.4 



0401 



Image non-display area 



0403 i 
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FIG.7 



Video signal quantization 



0700 



Analog Image signal is split into image color 
signal and synchronizing signal by signal 
splitter 0611. 



0701 



Image color signal is quantized by A/D 
converter 0612. 



0702 



According to separated synchronizing signal, 
horizontal and vertical position of currently 
quantized pixels are calculated by address 
generator (0613) and output as pbcel 
addresses. 
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FIG.8 



Frame buffer write/read sequence 



0800 



One of the frame memorizes is chosen as a 
write memory by write address selector 0625. 



0801 



The other frame memory is chosen as a read 
memory by read address selector 0626. 



0802 



Waiting for write address selector 0625 to give 
an address to indicate the frame top position. 



0803 

Repetition 



0804 



0805 



END 1 



Until writing of 
all pixels for 
one frame is 
finished. 




Input pixel data is written at the 
address supplied to write address 
selector 0625 in the write frame 
memory. 




0806 


Pixel data is read out from the 
output address of geometric 
transformation block 0630 on the 
read frame memory and trans- 
ferred through read data selector 
0627. 


0807 




The write and read frame memorizes 
switch their functions. 
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FIG.9 



^ Geometric transformation ^ 



0900 



Repetition 



END ) 



0901 



Geometric transformation vector 
table is read into address displace- 
ment memory 0632 through control 
parameter input terminal 0602. 




0902 




0903 




Unless re- 
inrtialization of 
address dis- 
placement 
memory 0632 
is requested. 




Geometric transformation vector data 
(x[r, c], y[r, c]) at each input address 
(r, c) in address displacement memo- 
ry 0632 Is read. 







0904 



Address generator 0631 calculates 
and outputs (r, c) + (x[r, cj. y[r, c]). 



FiG.10 



(^i.l.Yl.l) 



(^2.i.y2.i) 



(^1.2. yi.2) 



t''480,1>y480,l) 



■sv 



(^480,640» y480.64o) 
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FIG.11 



Color transformation 



1100 



Repetition 



1101 



Color transformation parameter table 
is read through control parameter 
input temiinal 0602 into pixel data 
conversion parameter memory 0642. 



1102 



Unless re- 

initialization of pixel 
data conversion 
parameter memory 
0642 is requested. 



1103 



Color transfomiation parameter 
i(P'r,c • ^r,c ) I f=0,...N} for each of 
red, blue and green components 
at each input address (r, c) in 
pixel data conversion parameter 
memory 0642 is read. 



1104 



Pixel data converter 0641 
transforms the intensity of each 
color component outputted 
from frame buffer block 0620 
using eq.1 and outputs it to 
video signal generator 0650. 



END 
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FIG.12 
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FIG.13 
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FIG.14 
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FIG.15 
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FIG.16 



Geometric transformation control 
data generation. 



1600 



Geometric transformation parameters for image 
correctors 0281, 0282. 0283, 0284 are set to zero. 



1601 



For each 
projector 



^ END ) 



1602 



Test pattern generator 0270 and image signal selec^ 
tor 0260 are controlled so that the image signals for 
the pattern shown in FIG. 13 are supplied to the 
respective projectors through image correctors 
0281 , 0282. 0283, 0284 for projection on screen 
0140 at the maximum output size that the projectors 
can handle. 



1603 



The image state on screen 0140 is photographed to 
be read as image data by screen state monitor 
camera 0130. 



1604 



The read image data is processed to determine the 
coordinates of positions of characteristic in the 
pattern. 



1605 



Positional coordinates of characteristic points are 
converted into data in the frame memory coordinate 
system using eqs. 2 and 3. 



1606 



Geometric transformation vector generation. 
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FIG.17 



Geometric transformation vector generation. 



1700 

Point-set on border lines, as defined by eqs. 4 and 5, of 
maximum image projection ranges is produced by linear 
interpolation based on positional coordinates of charac- 
teristic points on border lines of projected Images from 
the projectors. 



1701 

Border line intersections of neighboring ranges are calcu- 
lated from the point-set on border lines of maximum image 
projection ranges. 



1702 

Effective partial border lines as defined by eqs. 6 and 7 
are calculated from border line intersections. 



1703 

Points to which effective partial border line end points move 
are calculated using eq.9. 



1704 

End point movement vectors for effective partial border 
lines are calculated using eqs. 13 and 14. 



1705 

Movement direction vectors for effective partial border lines 

are calculated using eqs.15 and 16. 



1706 

Border lines of optimized image projection ranges are cal- 
culated using eqs.19 and 20. 



1707 



Geometric transformation control parameters for the entire 
maximum image projection ranges are calculated using 
eq.31. 



^ END 1 
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FIG.18 



^ Pixel data conversion parameter 
^ generation. 



1800 



N-division linear function parameters appropriate to 
identity transformation are loaded on image correctors 
0281, 0282, 0283, 0284 as pixel data transformation 
parameters. 



1801 



1802 



1803 



For each 
projector 



For each sample 
point on border 
line of optimized 
image projection 
range 



Colors with brightness levels graduated 
in (N 1) steps, into which the whole 
(minimum to maximum) brightness 
range of each color brightness levels 
on the screen are measured. 



1804 



N-dtvision linear approximate function 
for the measured color component, 
fX(z), is calculated. 



1805 

Optimized color component function g(z) 
is calculated using eq.32. 



1806 

N-division linear function parameter as 
defined by eq.38 is calculated from 
optimized color component function g(z) 
and measured color component function 

fX(z). 



1807 



Color transformation function nXlx, y]^^) for the 
entire optimized image projection range is calculat- 
ed using eq.40 to fmd an appropriate N-division 
linear approximate parameter. 



t END ) 
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FIG.19 
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FIG.20 
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FIG.22 



2281 V 



2201 



2202 



2282 t 



2203 

A. 



2283 



2284 



2204 



12211 



2212 



2243 



2241 



2231 2242 



2232 



1/ 



2213 



2233 



2244 



0-0 — <><I>- 



if 



2214 

2234 
2200 



Image 
Splitter 



-<>- 



Calibrator 



Pattern 
Generator 



BNSOOCIO: <EP 1039749A1J_> 



38 



EP 1 039 749 A1 



FIG.23 
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FIG.24 
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FIG.25 
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